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Abstract 

Given a new definition for the entropy of a cellular automata acting 
on a two-dimensional space, we propose an inequality between the 
entropy of the shift on a two-dimensional lattice and some angular 
analog of Lyapunov exponents. 



1 Introduction 

A two-dimensional cellular automaton (CA) is a discrete mathematical ideal- 
ization of a two-dimensional spacetime physical system. The space, consists 
of a discrete, infinite two-dimensional lattice with the property that each 
site can take a finite number of different values. The action of the cellular 
automaton on this space is the change at each time step of each values of 
the lattice only taking in consideration the values in a neighbourhood and 
applying a local rule. 

Since this automaton act on a two-dimensional lattice, this map has been 
used as model in many areas (Physics, Biology ...) (see Wolfram[0]) and 
seems to be more usefull in pratice than the one-dimensional case. Never- 
theless there is very few mathematical results in the two-dimensional case 
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except the work of Willson [7j, Margara j2] about ergodicity and density of 
periodic points of linear two-dimensional (CA). 

The first cellular automaton defined by Von Neumann and Ulam was 
two-dimensional one for theoritical self-reproducting biological systems as 
the well knwon game of life defined by J. Conway. 

In jHJ Shereshevsky defined the first Lyapunov exponents for one-dimen- 
sional cellular automata and establish and inequality with the standart metric 
entropy. Then he asked for a generalisation of these results in higher dimen- 
sions and qualify this extension as a challenging problem. This is the topic of 
this paper : first defined a natural equivalent of metric entropy which is finite 
for all two-dimensional (CA) and try to rely this value with a generalisation 
of (CA) Lyapunov exponents in the two-dimensional case. 

Entropy is an isomorphism invariant for dynamical systems see (Denker 
PP)and can be seen as a measure of the disorder of the dynamical system. 
It is always finite for a one-dimensional (CA). In the two-dimensional case 
the metric entropy is in general not finite when the shift metric entropy is 
positive. M. Shereshevsky postulate that a two-dimensional (CA) have an 
entropy equal to zero or infinite. Some results shows that for additive one 
the conjecture is true. 

So we propose here a new measure of complexity for two-dimensional (CA) 
: the Always Finite Entropy (AFE) of a two-dimensional cellular automaton 
F denote by h 2 J^{F). In section 3 we show by examples that the (AFE) give 
equivalent values of entropies of one-dimensional cellular automaton rules 
embeded in a two-dimensional lattice. 

Then like in the one-dimensional case (see Shereshevsky Tisseur jS] 
) we defined analog of Lyapunov exponent of differential dynamical systems 
for (CA). These Lyapunov exponents can be seen as the speed of propagation 
of perturbation in a particular direction. These Lyapunov exponent can be 
seen more like a generalisation of those defined in the one- dimensional case 
than a direct transciption of the differential case. 

Hence using some generalization of Shannon theorem we obtain an in- 
equality between the always finite entropy of the (CA), the two-dimensional 
entropy h^(<Ji, a 2 ) and a map which depends on directional Lyapunov expo- 
nents : 

hf{F) < hpfaa*) x (| yf(2) J X(e)d9 + fj 

It seems that this result can be generalised in higher dimensions. 
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2 Definitions 



2.1 Symbolics systems and cellular automata 

Let A be a finite set or alphabet. Denote by A** the set of all two-dimensional 
concatenations of letters in A. The finite concatenations are called blocks. 
The number of letters of a block u G A** is denoted by \u\. The set of 
infinite lattice x = (^(ij))(i,j)ez 2 is denoted by A z . A point x G A % is 
called a configuration. For each integers s and t and each block u, we 
call cylinder the set [w]( S)t ) = G A z : y {s+iit+j ) = u^j)}. For zi < 2 2 
and ji < j'2 in Z we denote by 2*2), (Jhh)) the rectangular block 

• • • J2)) • • • x (u+i,j2)) x («2,ii) • • • x faja)- We endow A z 

with the product topology. For this topology A z is a compact metric 
space. A metric compatible with this topology can be defined by the dis- 
tance d(x,y) = 2~* where t = min{s = >/i 2 + j 2 \ such that X(i,j) 7^ V(i,j)}- 
The horizontal shift a\. A z2 — > A z2 is defined by : ai(x) = (£(t+i,j)(i,.?)ez 2 - 
The vertical shift a 2 : A 1,2 — > A 1,2 is defined by : ai(x) = (^(ij+i)(ij)e2 2 - 

The dynamical system (A 1,2 , cr 1; cr 2 ) is called the full shift. A subshift X 
is a closed shift-invariant subset X of A z2 endowed with the shifts <j\ and o"2- 
It is possible to identify (X, ai, cr 2 ) with the set X. 

If a = {A\, . . . , A n } and /3 = {-Bi, . . . , B m } are two partitions of A 1 
denote by a V (3 the partition {Aj Pi Aj i — 1 . . . n, j = 1, . . . , m}. The metric 
entropy h^T) of a transformation T is an isomorphism invariant between 
two /i-preserving transformations. Put H^(a) = ^2 A€a p,(A) log fj,(A) where 
a is a finite partition of the space. The entropy of the partition a is de- 
fined as h^a) = lim^oo l/nif /J (V" = r 1 T~*a;) and the entropy of (X,T,ji) as 
sup a A A4 (a). 

A two-dimensional cellular automaton is a continuous self-map F on A 1,2 
commuting with the two-sided shift. We can extend the Curtis-Hedlund- 
Lyndon theorem £Q an state that for every two-dimensional cellular automa- 

2 

ton F there exist an integer r and a block map / from A r to A such that: 

F{x) (i.j) f \Xi—r,j—rj ■ ■ ■ j ^(ij); • • • > x (i-hr,j+r)J ■ 

As in the one-dimensional case we call radius of the cellular automaton 
F the integer r which appears in the definition of the associated local rule. 
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2.2 Entropy of two-sided shift 

Recall that o\ and a 2 are respectively the horizontal and the vertical shift 
acting on the space A z . Let et\ be the partition of A 1, by the central 
coordinate (0,0) and (A n ) ne ?q be a sequence of finite sets of Z 2 . We denote 
by \A n \ the number of element of A n . Define a£ 1 '°' 2 = V(i,j)eA n a i t(T 2 Ja i 
and a° 1,cr ' 2 (x) as the element of the partition a^ 1 ' 02 which contains the point 
xeA z \ 

In ^E] Ornstein and Weiss give an extension of the Shannon McMillan 
theorem for a class of amenable groups. These results can be used for Z 2 
actions if the sequence of the finite partitions verifies some special conditions. 
First the set A n must be averaging set, this mean that 

lim \<Ti(A n )AA n \/\A n \ = 0, with i=l or i=2 

n^oo 

and A denotes the symmetric difference of two sets. 

Then to be special averaging, the sequence (A n ) nG N have to satisfy A\ C 
A 2 C ...A n . 

Finaly if A n is a special averaging sequence, for almost all points x G A 1,2 
(see jl]) one has 

h f ,(a 1 ,a 2 ,a 1 ) = lim — j— - log/i (a° uCT2 (x)) . 

n^oo \A n \ 

Remark that h^ai, a 2 , ot\) = h ll (ai,a 2 ) because ot\ is a generating partition 
for 01, cr 2 - 

We are going to use this result in the case of sequences (A n ) n€N which 
are not rectangles (in this case we have the equality by definition ) and show 
that 

f - log/i {a^{x)) A 

/ hm ——. dn(x) = h^(a 1: a 2 ). 

J A1 2 n^oo \A n \ 

2.3 Always finite entropy of a two-dimensional CA 

Let F be a two-dimensional cellular automata and a shift ergodic and F 
invariant measure. Let a be a finite partition of A z . Let h^F, a) be the 
entropy of F with respect of the finite partition a. If h^(ai, er 2 ) > then in 
general it exists a sequence of partition a n such that h^(F, a n ) goes to infinty 
(see the examples below). 
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For this reason we propose a new kind of entropy for a two-dimensional 
cellular automata F, the always finite entropy (AFE) denoted by /i 2D (.F). 
For this definition we need to defined a sequence of finite partitions a![. 

Let B be a two-dimensional squarred block that is to say a double finite 

squarred sequence of letters B = (-B(j i i))(o<i<n ; o<j<n)- We denote by [-B]^'^ 

the cylinder which is the set of all the points y such that y(ij) = B^ with 

< % < n and < j < n. We call n-squarred cylinders blocks the cylinders 
r ri 

L^J (0,0) • 

For each positive integer denote by a n the partition of A z into \A\ n 
n-squarred cylinders blocks 
Then define 

hl D (F) = \iminf \(F,a n ). 

Later we will see (main theorem ) why this entropy is always finite. 

Questions 1 // we only ask to fix a number of k x n 2 coordinates (k G N*), 
in a partition a* n , is liminfp^oo h^(F, a* n ) = h 2 l D (F) ? 



Questions 2 If what case a n)) n6N *s a converging sequenced 
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2.4 Directional Lyapunov exponents 

An almost line is a doubly infinite sequence of coordinates (u n ,v n ) ne z 
with (u ,v ) = (i,j)- Let E(x) be the integer part of a real x. Consider the 
continuous space M? and a line which pass by the coordinate and make 
an angle 6 with the vertical line. This line is the set of points (x, y). Starting 
from (x,y) = and making grow the variable x the succession of value 
(E(x), E{y)) gives the sequence («„, i> n )neN of the positive part of the almost 
line Ltjy We obtain the negative coordinate by decreasing the variable x 
and taking again the sequence (E(x), E(y)). 

Let Wt C Z 2 be the half plane of the lattice consisting of all the coordi- 
nates situated in the halph plane delimited by the almost line ~ and which 
contains the central coordinate (0,0). For all point x G A %2 note W^^(x) 
the set of all points y such that y( a ,b) — x {a,b) f° r ( a ? b) G Wt^. 

Let define the propagation map of information : A^(9) during n iterations 
in the direction 9 for a two-dimensional cellular automaton F : 

AM(x) = mm{s = ^Tf\F k {W^(x)) C W e {m {F k {x))\l <k<n}. 
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Put A£(0) = ma,x{A^(6)(x)\x G A z2 }. Remark that for each real 9 there 
exist also a couple = G n F{9) of positive integers such that a/? 2 + j 2 = 

Lemma 1 For all real 9 G [0, 2%] the limit lim^oo A "J 6> - ) exzfo. M^e denote 
by \(9) these limits. 

Proof 

First prove that for each couple of integers m, n and point x G A 1,2 , one 
has A£ +n (6>) < A£(0) + A£(0). 

To simplify put (s,i) = G n F(9) and (u,u) = G n F(0'), s « [ A n(^) c os(#)J 
and i « L A £(#) sin(fl)J . 

From the definition of s, £ one has for all point x G A 1,2 F n (W^ st ^(x)) C 
^f 0;0) (F-(x)). Then 

F m+n (W^ t) (x)) C F m (^ 0j0) (F"(x))) = ^(Wft^K o a\ o 

And by definition of -u and i> we obtain 

J^K^K ° °l o F n (x))) C W^ 0) K o al o 

Then F m+n {W e (s+u t+ „ } K o (t\{x))) C 0) K o a£ o F m+n (x)), this implies 
that i^W^^s)) C W° m (F«««(x)). 

Finaly we can conclude arguing that A^ +m (9) < a/( s + u) 2 + (t + t> ) 2 = 
v ^+F+v^+l^ = A^ , (0)+A^(0). 

If we fix 0, the numeric sequence " w v ; is a subadditive sequence an so 
converge to inf n A "J^ . 

□ 



2.5 Lyapunov exponent surface 

The computation of entropy of Z 2 action using the Shannon-Breiman-Mc- 
Millan Theorem need to know the number of coordinates fixed for an element 
of the partition a™ ,F (see section 2.2). This number of elements can be seen 
as the surface of a polygone on the squarre lattice. 

First define the sequence of maps G n from [0, 2tt] to Z 2 such that G n (9) = 
(|V2ncos0l ; \V2nsin9]) if 9 G [0, tt] and G n {9) = (0,0) if 9 e]n,2n]. Let 
T n be the set of coordinates of the squared lattice in the interior of the set 
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of coordinates = G n F(^) + G n {^), < k < n. Let T n = {(a,b) G 
N 2 |3(i, j) = G{6){0 G [0,2tt]) \Va 2 + b 2 < ^Tp + G{9)}. 

Remark that we decide arbitrairely to rely the steps in the variations of 
the angle 9 (A9 = ^) to define the set T n with the number of iterations of 
the cellular automaton. Some small changes in the definition of T n will not 
change the main result. 

Let define a new surface T*. The surface T* is the intersection of all the 

almost half planes W " 2 ^ k rF( 2 2L k ) (defined in section 2.4) with < k < n. 

We call T n the Lyapunov exponent surface and T* the surface of common 
behaviour. As it is difficult to give an expression of the surface T* using the 
Lyapunov exponents \(9) in order to establish an inequality with h 2D (F), 
we are going to show that the part of T* wich do not belong to T n became 
very small in comparaison of T n when n increase. 
Let T** = T* — (T* — T n fl T*). 

Lemma 2 For each point x G A 1 one has 

I I 



lim 

n— >oo 



\ r r* 

I n I 



Proof 

Let \T**\ and \T*\ be the respective surface of the sets T** and T*. Let 
DT n = \T*\- IT** I, one has B = |T ", l ~ DTn . As the sets T* and T** are 

I -*- n I I n I 

polygones the difference of the two surfaces is at least a sum of n surfaces of 
triangles. We decide to bound the surface of these triangles by surfaces of 
rectangles. 

For each < % < n we consider the rectangle defined by the points 
pi GF(f _ M) + G(f _ M). f gf^Mz^H) + G(f _ Mil)), the point p2 

7T 27T 27T 

which is the intersection of the almost line L, 2 nn >" and L n o^+n aw^n 

(0,0) CF( ( - 1 ) I C( ( J ) 

and the fourth point which closed the rectangle . 

Denote \r^\ the surface of this rectangle. If the point P2 is at the left of 
side of pi then put \r\\ = 0. One has DT n < Y17=+ l r «l- O ne nas r « — ^ x ^» 
where /j is the width and hi the lenght. One has k < hi x tan(^). 

Hence 

r i = l i xh i < (^) 2 tan(^) and ^ = (A£(f ) + V2ncos2m/n) tan(f ) 
so 7~j < (A^(— ) + v^2^cos27ri/n) 2 (tan(^)) 3 and when n goes big enought 
n < (A^(^) + v / 2ncos2vrVn) 2 (^) 3 « ^ = f where K is a constant. 
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Therefore DT n < n x r { < — x n = K . So < |T f ' , x then as we suppose 

n \ 1 n\ \ 1 n\ 

|T*| goes to infinity then lim^oo = 1. 

□ 

Let a\ the partition by the central coordinates defined in the section 2.3 
and d\{x) the element of the partition which contains de point x. Denote 
by n {x) the element of the partition V \i^ eT *a\a{{ai) which contains de 
point x. 

Proposition 1 For all < k < n and all x G A 1,2 one has F k ^a^' Tn (x)j C 

a n (F k (x)) and a^(x) D a? T "(i). 

Proof 

Suppose that there exists y G a n n (x) such that there is some < k < n 
with 

F\y) ((0, 0); (n, n)) ± F k {x) ((0, 0); (n, n)) . 
We are going to define a sequence (Zi(x))i e ^ of subsets of a n n (x). Let 

Z t (x) = {ze X\z G afr(x) ri m=0 W n ^ 2 (x)}. 

Remark that Zi(x) D Zi + i{x) and Z n (x) = {x}. 

From the supposition there exist < / < n such that there exist u G Z\{x) 
and v G Z t+1 (x) such that for all < k < n one has F k (v) ((0,0); (n,n)) = 
F k (x) ((0, 0); {n, n)) and there exists < k < n such that F k {u) ((0, 0); (n, n)) 
^ F k (x) ((0,0); (n,n)). As u G Zj(a;) and v G Z l+1 (x) then 

2-n-i + l 

It follows that 
and 

then A^(^tl) > v^Tf where = G n F(^±±), which which contra- 
dict the hypothesis, so we can conclude. 

□ 
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3 Examples of h v computation and a first 
inequality 

In this section we give different justification of the choice of the definition of 
the Always Finite Entropy. From this section we denote by X the full shift 

A^. 

3.1 Examples 

Using tree examples we are going to show that the (AFE) is a natural exten- 
sion of the standart entropy apply in the one-dimensional case. 

In the three examples we consider the two-dimensional lattices on an 
alphabet which contains two letters. Let A = {0, 1} and consider the space 
X = A 1,2 . We endows the space X with the uniform measure \i. This measure 
is the unique measure which gives the same weight to all cylinders with the 
same number of fixed coordinates. 

• The first example (iq) is the horizontal shift named cq in section 2.2 . 
This (CA) is defined by the rule [Fi(x)]^j) = x^ + ij). Using the definition of 
metric entropy one has 

hJF,ai) — I — lim — \og [i(al' Fl {x))d[i(x). 
J x n 

As \x is the uniform measure and iq act on each point x in the same way it 
follows that h /x (F 1 , cq) = - lim n _ >00 ± log/i(cq' Fl (:r)). 

Clearly a^ Fl (x) = z((0,0); (n,0)) so we have /i(cq' Fl (a;)) = 2~ n -\ then 
h^Fu a ± ) = lim™ J(n - 1) log(2) = log(2). 

Using the same methods we obtains h^(Fi,a p ) = plog(2) and therefore 
hl D (F 1 ) = lim^ iplog(2) = log(2). 

We remark that the value of h'j l D (Fi) is the same that the value of the 
standart entropy of the shift in the one-dimensional case and is equal to the 
entropy of the two shift action h^ai, <t 2 ) on X. 

• The second example named F2 is a (CA) based on an additive rule 
on the right and left first neigbhours. This (CA) is defined by [F(x)](ij) = 
X(i-ij) + x (i+i,j) modulo 2. In order to take in account the right and left in 
an independantly way we need to consider partitions a n with n > 2. Clearly 
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one has a% >F *(x) = x((-n,2); (n + 1,0)) so n{o%' F2 {x)) = 2~ 2 ( 2n+2 ) and in 
general /i(a"' F2 (x)) = 2~ p ( 2n+2 ) then /i 2D (F 2 ) = lim^^ ±2plog(2) = 21og(2). 

Remark that the value of h 2 l D (F2) is the same that the entropy of the 
simple additive (CA) in the one-dimensional case. 

• The third example (_F 3 ) is an additive rule with the upper and right first 
neigbhours. This (CA) is defined by the rule [F(x)]^j) = + ^(i+ij) 

modulo 2. 

Recall that the set a'p' F3 (x) is the element of the partition V™ =0 F 3 _! 'a p 
which contains the point x. First remark that for any x G X one has 
li{a^ Fi {x)) = 2 -4 because we have to fix 4 coordinates, the squarre delimited 
by the position (0, 0) to (1, 1). 

Fix x G X and choose y such that y(( ,o) ; (i,i)) = £((o,o);(i,i)); ^3(y)((o,o) ; (i,i)) 
= i 7 3(x)(( 0) o) ; (i,i))- In this case we have to fix 2/(0,2) and 1/(2,0) but we have the 
possibility to choose 2/(1,2) or 2/(2,1)- We can not choose these two coordinates 
in an independantly way. We deduce that (j,(al' Fi (x))=2 x 2~ 4 x 2~ 4 = 2~ 7 . 

More generaly for a p (x) we have to fix p 2 coordinates, then in al ,F {x) we 
must fix p 2 + 2p coordinates (y(o, p ) ■ ■ ■ 2/( P -i, P ) and (2/( P , P -i) • • • 2/(p,o)) but there 
is two ways of choosing the coordinates in the angle 2/(p-i,p) and 2/( P , P -i) so 
/i(Q^(i))=2x2-(" 2+2 "'=2 2 ('" 1 ). 

In order that F 2 (y) G a p (F 2 (x)) we have to fix 2p + 1 more coordinates 
in y with again two possibilities which multiply the first two possibilities, so 
fi({y\F 2 (y) G a p (F 2 (x))}) = 2 2 x 2^ 2+2 ^ = 2^ 2 ^ and 

»({y\Fi(y) G a p (F 2 (x)); F 3 (y); F(y) G a p (F(x)); y G a p (x)}) 

= 2" (p2) x 2~ (2p ~ 1} x 2~ (2p ~ 1} = 2 p2+2{p ~ 1 \ 

In general, considering all the configuration such that F^(y) G a p (F^(x)) 
(0 < i < n), we have to fix 2p+i more coordinates (with 2 l+l possible choices) 
in order that F^ +1 (y) G a p (F^ +1 (x)). The set a^ Fi (x) is the union of 7rf =1 2* 
cylinders block with a number of 2p + i fixed coordinates. Hence in order to 
have Fl(y) G a p (F^(x)) with < i < n we have to fix p 2 + Y^=o(^P + 
coordinates but there is vr^ 1 2* possible choices of coordinates. Finaly as 
all the configurations have the same weight for each x G X and one has 

H (a n ' F *(x)) = 2("( p2+E -0 1 ( 2 P+ i ))+Er = i2 l ) = 2 -(p 2 +(2p-l)n)_ 

As in general /i(a™- F3 (x)) = 2-« 2 p- 1 W) then 

V(F 3 , a p ) = hm (2p ~ 1)n + p2 log(2) = (2p - 1) log(2) 
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and hf{F) = lim^oo i(2p - 1) log(2) = 21og(2). 

Remark that tij?(F 3 ) = h 2 f{F 2 ) which seems natural and coherent. 

3.2 Equivalent and upper bound maps of h 2D 

Here we define two maps which can be related to the always finite entropy. 
The first one is an upper bound required to establish the main inequality 
with the Directional Lyapunov Exponent, the second one is an equivalent 
definition of the (AFE). 

Proposition 2 For each F invariant measure \i one has 

hf{F)< [ liminf - l0g/i( f (x)) ^). 

Jx n ^°° n 

Proof 

Let pi be a sequence such that lim™-^ — hfj,(a Pi , F) = h 2 ®{F). Given 
any real e > 0, there exists an integer / such that if i > I then [h'ff^F) — 
^K,F)|<e. 

From the definition of the metric entropy and the dominated convergence 
theorem , one has 

h lx (a p ,F)= I Jim „ J;j d/i(x) = Jim / \ J;j d/J,(x). 



I x n ^°° n n— >oo j x n 

As the sequence 

\og{^a n p F {x)))d^x)] = (H(a n p F )) nm 

X J nGN 

/ tt, n.F \ 

is a subadditive sequence (cf Denker J.), then ( — ^ — )) converge to 
inf n — ^ — - = h^(a p , F). Then for all n and p in N one has ^h^(a p , F) < 



f x — p z — -^-dfi(x) and taking e — > we can conclude. 

The second proposition give a new seing of the always finite entropy. 
Proposition 3 For any F invariant measure [i one has 

h? D (F ) =limliminf / V V 9n J -^-da(x). 

M e^O rc—oc J x [e x n 2 ] 
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Proof 

Let (pi)jgN be a subsequence such that lim — h^F, ci^ F ) = hf^iF). 
Given any real rj > 0, there exists an integer / such that if i > I then 
\K D ( F )-FMF,a% F )\<ri/3. 

Then there exist an integer JVi such that for all n > JVi one has 



1 1 

-h^(a p ,F) - - 
V PJx 



log (a£(a;)) 



d/j,(x) 



< V /3. 



Take e < and define n» a subsequence such that [erij] = p^. Let L(e) = 
liminfn^oo f x log (" p ^ dji{x). Denote by rij a subsequence of rii such that 

— log [ Oi ^ (^-0 ) 

J x ^ -dji{x) converge to L(e). There exist an integer N 2 such that 

if rij > N 2 one has 



\ nj 2 e] 



dji(x) — L(e) 



< V /3. 



If JVi > N 2 take N — Ni and if JVi < iV 2 put P = [eiV 2 l in the first condition 
and N = N 2 . As the sequence J x ^ — -dji(x) is a decreasing sequence 



we obtain that for all e' < e and all rij > iV 



[x 



dji{x) 



< rj. 



So 



h (F) = limliminf 



log (/j (a))) 



dji(x). 



-log(agQr)) 



dji(x) J and —h^otp^ F) are a decreasing 



As the sequences ^ J x 
sequence then J* x Jn^if — -dji{x) < hf l D (F) then we can conclude. 



□ 



Remark 1 This second relation is not usefull to establish an inequality with 
the shift entropy and the directional Lyapunov exponents. 
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3.3 First inequality 

Proposition 4 For all F \i ergodic two-dimensional ( CA ), one has 

hf(F) < <t 2 ) x (A(0) + A(vr) + 1) x (A(tt/2) + A(3tt/2) + 1). 

Proof 

Using Proposition El we only need to show that 

lim - l0g ^ x)) d^ X ) 

< (A(0) + A(vr) + 1) x (A(tt/2) + A(3vr/2) + 1). 

Let R n be the rectangular set of couple of integers {i, j) such that 
-A£(3tt/2) < i < A£(tt/2) + n and A^(vr) < i < A£(0) + n. 
From the definition of T*, clearly one has T* C Rn, so using Proposition 
H] we obtain 

&n F ( x ) D ( y {iJ)€T*o-l o a J 2 a n )(x) D (V {itj)eRn a\ o a 3 2 ot n )(x). 
Put (V(i d ) eRn a\ o a 3 2 a n )(x) = a%(x) we have 

log/4 j a n( x )) 
l x n— »oo n 2 



hf{F) < / lim -^^^ Mx)- 



So we can write 



|i2n| ™ 2 



From de definition of the two-sided shift one has 

/" -log/i(a^(x)) , . . , 

/ lim r— d/i(ar) = /i M (<7i, cr 2 , «i) = M°i> ff 2 ). 

J x n^oo \R n \ 



Hence we have 



hf{F)<h„{a 1 ,a 2 )x lim 



The surface i? n is the surface of a rectangle of width A^(0) + A^(n) and 
length A£(7r/2)+A£(37r/2). So K(x)| = (A£(0) + A£(tt) +n) x (A^(7r/2) + 
A£(3vr/2) + n). 
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Then 



lim \Rn\ _ ( A£(0) | A£(tt) | n y Agfr/2) | A£(3tt/2) | n 



n—>oo n 



n 



n 



n 



n 



n 



n 



= (A(0) + A(tt) + 1) x (A(tt/2) + A(3tt/2) + 1). 
So we can conclude. 



□ 



4 The continuity of the Lyapunov Exponents 

The study of the way the information propagate in a specific direction is in- 
teresting in itself. The result in this section permit to establish a better upper 
bound for the value of the always finite entropy because we now consider the 
Lyapunov surface which is in general leather than the simple squarre defined 
in the previous equality. 

Lemma 3 For all n G N* big enought and for all 9 G [0, 2tt] there exits 5 > 
such that there exists a positive integer K such that for all 9' < 5 one has 

^(0 + 0') A£(6>) 



n 



n 



< K x \6'\. 



Proof 

First recall that A^(6) = max{A^(^)(a;)|x G X}; clearly we have 

A£(0) = max{s = \/ i 2 + j 2 \F k (x)(a) = F k {y){a)\x G X ; < k < n} 

where a = ((— r, r); (0, 0)). 

From de definition of G n F, if (i,j) = G n F(9), then for each x G X we 
obtain F k {x) ((-r,r); (0,0)) = F fc (y) ((-r,r); (0,0)) where y £ W, 



x . 



Remark that there exist <5 G [0, 27r] such that if < 0' < 5 then | tan^'| < 
29'). 

As the information can not propagate more than rn coordinates in n 
iterations, it follows that F k (x) ((-r,r); (0,0)) = F k (y) ((-r,r); (0,0)) if y G 



W, 



6+0' , 

(u;v) 



x);u = i+ \(r + l)nx2\0' \ xcosO] and v — j+ \(r+ l)nx2\9'\ x sin 9}. 

This implies that A£(0 + 9') = Vu 2 + v 2 = 2 + j 2 + (r + l)n x 2|0'|. 
Finaly it follows that 

K(0 + 9') k F n {9) 



n 



n 



< 2(r+ 1)\9'\. 



□ 
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Proposition 5 For each positive integer n the map — are continuous 

map, moreover the map the sequence converge uniformly to X{9) which 
is a continuous map. 

Proof 

From Lemma 2 one has for all nGf and for all for all 9 G [0, 2ir\ there 
exits 5 > such that for all 9' < 5 one has 



n n 



< K x 9'. 



So these maps are uniformly equicontinuous maps. 

As the maps are equibounded by r and are uniformly equicontinuous then 
we can use the Ascoli-Arzela theorem which told us that that there exists a 
subsequence rij such that the sequence An J 6> - > are uniformly convergent. As 

from Lemma 1 the sequence — converge then we can conclude saying that 

the maps A " ^ converge uniformely to X(9). 

□ 



5 The inequality 

Theorem 1 For a shift ergodic measure \i of a two-dimensional shift and a 
two-dimensional cellular automata, we have 

K D (F) < h^az) x (f 2 ^ + V2£\(9))de + £de] 

Proof From Proposition 2 one has 

hf(F)< [ liminf-'^y^W 



From Proposition [U one has {v (i^T^^a^ai)) (x) = an n (x) C a"' F (x), 
thus 



h 2 u D (F)< I liminf ^vv^yi-^/ YlLL d ^ x 



log// ((V( ij)6 T*o-io-i(ai)) (x)) 



X 



n 



2 



and 



logyU (otn Tn {x)^ \rji* 



hf{F)< I liminf v ■/ xllf d ^ x ). 

x n ^°° \J-*\ n 
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Since (T^)„ gN is a special averaging sequence, we can use the extented 
Shannon-Breiman-McMillan Theorem (cf Orstein j^j) which implies that for 
//-almost all points x one has 



log \i (a 



lim 7=-, = h fl (a 1 ,a 2 ,ai) = h fl (a 1 ,a 2 ). 

n— >oo / * 

I n I 

Hence one obtains 

IT" 1 * I 



hl D (F)<h ll (a 1 ,a 2 )xlimm{ 
From Lemma 1 one has 



liminf Mr = lim inf. L^lA^l 



irp** I I r~p I 

lim inf — ^— < lim inf — ^~ 



IT I 

Now we try to evaluate lim inf Mp. As \T n \ is a sum of triangles of 
height hi = A£(2ni) and base b { = A^(^) x tan(^) when [f J < « < n. For 
a real 77 small enought and n big enought we have 

\ Tn \ _ g >< I (ElT 1 (Agg) + v^) 2 + Er=Lfj AjUg) + ; 

n 2 n 2 

-f(s(K^)' + ^ +i ) + S J ^ ,,+ 5 

From Proposition 5 the sequence of maps — converge uniformely to the 
continuous map A. This implies that 



n^oo n / — ' 21 n / n 



i=0 

- 71-1 

2 



2ni, 

n ' 
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Therefore using the uniform continuity of the map A and the Riemman 
definition of the integral we obtain liminf^oo l^tMi = lim^^ J^^li and 



lim \ux)\ = r>m dd+ r>m de+ ^- {2) r x{e)d0+ r de . 

n ^°° n Jn 2 Jo 2 Jo Jo 



Finaly 

o 2 



hi 1J (F)<h fl (a 1 ,a 2 ) x 



f'TT f'TT \ 

d# + 7(2) y A(#)d# + y d0j . 



□ 



Remark 2 We could obtain a better upper bound if we will be able to esti- 

IT** I IT 1 I 

mate the value of lim inf n ^oo L ^ L instead of lim inf ra ^oo . 
5.1 Computation of X(9) 

We compare here the two kind of upper bound (Proposition |2] and Theorem 
1) in the case of the example F% and different extensions of this map. 

In order to compute the first upper bound, remark that A(0) = 1, A(7r) = 
0; A(tt/2) = 1 and A(3vr/2) = 0. 

So A£ 3 = (A(0) + A(tt) + 1) x (A(tt/2) + A(3tt/2) + 1) = 4. We obtain the 
inequality 

hf{F) = 21og(2) < 4/i> 1)( x 2 ) = 41og(2). 
Now try to evaluate the second upper bound : 

x f 3 = f 27T [M£>L d Q + 7(2) ^ \{6)d6 + [ n d6. 
Jo 2 J Jq 

As no perturbation came from the left or under part of the latttice we 
only consider the Lyapunov exponents between and tt/2, that it to say 
we use S n = R n fl T n C T** where R n is the set defined in the proof of 
Proposition |21 So we have to compute 



d6+^{2) [ \{6)d9 + ^-. 

Jo ^ 



If 6 e [0,7r/4] then A(0) = cos(0) and if 6 e [n/A,n/2] then A(0) 
cos(tt/2 - 0). 
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Then A^ 3 = J^ 2 l -±^d6 + ^2 J Q w/4 cos(6)d9 + vr/2 = (f + \) + ^2 + f . 
We have A^ 3 = 3.628 < 4. More generaly for any integer k > 1 denote by 
i 7 ^ a (CA) defined by the local rule [F'^x)]^^ = xu+kj) + atyj+fc) mod 2. In 
this case we have A^ 3 = k 2 + 2k + 1 and A^ 3 = £; 2 (§ + ±) + y/2k + §. The 
difference between the two exponents increase when the value of k. 

5.2 Conclusion 

Because the value of the standard entropy appears to be zero or not finate for 
a two-dimensional (CA), the Always Finite Entropy is a map which allows to 
extend two kinds of results which appear in the one-dimensional case. The 
first one is the value of metric entropy of a (CA) for additive rules with the 
uniform measure. The second one is to connect the value of the entropy 
of the (CA) with the entropy of the shift and the speed of propagation of 
information (Lyapunov exponents). 

Is this version of metric entropy will be useful in more general dynamical 
systems for which the value of the entropy is not finate. 

5.3 Questions 

In these following questions F always represent a two-dimensional cellular 
automaton. 

• If F is bijective is it true that h(F) < oo and h 2D (F) = 0? 

• Is it possible that h^(F) > but h^(F) < oo (Shereshevsky conjec- 
ture)? 

• Is it possible that hl°(F) = and h^F) > ? 

• Is it possible to define directional exponents which do not depend on 
the maximum and nevertheless are continuous with the direction 6 ? 

• Is it possible to find a better upper bound which is equal to zero when 
the cellular automaton is the identity map? 

• In the three examples the value of h 2 l D (F) depends linearly of the radius 
r of the local rule. The expression of the upper bound depend on some 
square of \(9). We can wonder if there exist some cellular automaton 
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with the property that h^f is proportional of the square of the radius 
of the local rule. 

References 

[1] M. Denker, C. Grillenberger, K. Sigmund, Ergodic theory on 
compact spaces, Lecture Notes 527, Springer, Berlin (1975). 

[2] M. FlNELLIN, G. MANZINI, L. MARGARA Lyapunov Exponents versus 
Expansivity and Sensivity in Cellular Automata, Journal of Complexity 
14, 210-233 (1998). 

[3] M.A. Shereshevsky, Lyapunov Exponents for One- Dimensional Cel- 
lular Automata. J. Nonlinear Sci. Vol.2, 1-8 (1991). 

[4] D. Ornstein and B. Weiss, The Shannon- McMillan- Breiman Theo- 
rem for a class of Amenable Groups. Israel Journal of Mathematics Vol. 
44, N° 1 (1983). 

[5] P. Tisseur, Cellular automata and Lyapunov Exponents Nonlinearity 
13, 1547-1560 (2000). 

[6] S. Wolfram, Theory and Applications of Cellular Automata, World 
Scientific, (1986). 

[7] S. J. Willson, On the Ergodic Theory of Cellular Automata, Mathe- 
matical Systems Theory Vol. 9 N° 2, 133-141 (1975). 



19 



